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I.  INTRODUCTION 

The  cross  correlation  of  two  monochromatic  images  is  a  measure  of  their  similarity. 
Let  s^(x,y)  and  S2(x,y)  denote  the  images;  each  function  describes  an  image's  magnitude 
and  phase  over  the  input  aperture  of  the  correlator.  The  cross  correlation  of  s^  and  S2  is 
defined  as 

/*°°  z*00 

g(x,y)  =  J  J  sj(u,v)  s2(u+x,v+y)dudv.  (I— 1) 

-00  -00 

In  practical  applications  images  are  limited  in  spatial  extent,  and  a  finite  domain  of 
integration  would  suffice  in  (I— 1).  Generally  speaking,  the  greater  the  similarity  between 
Sj  and  S2  the  greater  the  peak  of  g  at  x  =  v  =  0.  If  s2  is  similar  to  a  spatially  shifted 
version  of  s^  then  g  will  exhibit  a  peak  at  a  coordinate  location  indicative  of  the 
displacement  between  the  images. 


For  what  are  mainly  technological  reasons,  a  direct  implementation  of  (I— 1)  is  not 
practical.  A  better  approach  for  obtaining  the  cross  correlation  involves  the  Fourier 
transform  operator  #.  It  is  easily  shown  that 


g(x.y)  =  5  *[  sjs2 ) 

(1-2) 

where 

■?!  =  3(8  J 

(1-3) 

^2  = 

The  main  reason  (1-2)  is  a  more  practical  implementation  of  the  cross  correlation 

operation  is  that  the  Fourier  transform  operation  (and  its  inverse)  and  multiplication  in 

the  spatial  frequency  domain  can  be  implemented  optically.  It  is  well  known  that  if  Sj 

appears  in  the  object  plane  of  a  converging  lens  then  Sj  appears  in  its  transform  plane  (the 

object  plane  lies  one  focal  length  in  front  of  and  the  transform  plane  lies  a  focal  length 

* 

behind  the  lens).  Also,  the  product  can  be  formed  by  imaging  on  a  transparency 

* 

having  an  effective  transmittance  of  S2-  Finally,  a  second  lens  can  be  placed  after  the 
transparency  to  take  the  inverse  transform  of  the  product. 
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These  ideas  are  incorporated  in  a  simple  coherent  optical  correlator  with  schematic 
given  by  Figure  1.  Input  s^  is  actually  a  diffraction  pattern  which  can  be  formed  by 
passing  collimated  laser  light  through  an  input  transparency  of  the  image.  The  resulting 
far  field  diffraction  pattern  is  focused  by  the  Fourier  transform  lens  onto  the  transparency 
containing  the  Fourier  transform  hologram  made  from  image  S2-  What  is  effectively  the 
product  of  the  transforms  appears  at  an  angle  off  normal  incidence  to  the  hologram:  the 
actual  angle  is  determined  during  manufacture  of  the  hologram.  Finally,  a  second  lens 
transforms  the  product  back  to  form  the  correlation  of  s^  and  s0. 

The  simple  ideas  outlined  above  are  developed  below.  Section  II  describes  an 
apparatus  used  to  manufacture  the  above-mentioned  Fourier  transform  hologram.  This 
device  is  referred  to  as  the  matched  filter  maker  in  what  follows.  Section  III  describes  an 
optical  correlator  of  unique  design  which  is  capable  of  performing  multiple  correlations 
simultaneously. 

II.  MATCHED  FILTER  MAKER 

Figure  2  depicts  a  schematic  of  the  matched  filter  maker.  All  components  shown 
are  mounted  on  (bolted  to)  an  optical  table.  As  described  below,  the  major  features  of  the 
filter  maker  include  1)  an  input  image  supplied  by  a  standard  television  camera,  2) 
computer  controlled  self  alignment,  3)  computer  controlled  exposure  sequencing,  and  4)  the 
ability  to  monitor  the  image  passing  through  the  system  on  an  auxiliary  television  monitor. 

The  input  image  to  the  filter  maker  is  captured  on  a  standard  television  camera. 

The  resulting  signal  is  displayed  on  an  enclosed  TV  projector  complete  with  lens  for 
writing  the  image  on  the  input  side  of  the  liquid  crystal  light  valve  (LCLV).  This 
arrangement  provides  greater  flexibility  and  convenience  than  that  provided  by  a  system 
where  the  input  image  is  focused  directly  on  the  LCLV.  A  diode  laser  within  the  system  is 
used  to  read  the  image  from  the  output  side  of  the  LCLV. 

This  laser  diode  has  a  nominal  wavelength  of  780  nanometers  (nm)  and 
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coherent  optical  correlator 


50  milliwatts  (mw)  maximum  output.  The  temperature  of  the  diode  is  controlled  by  a 
thermo-electric  cooler  and  feedback  system.  Also,  the  diode  current  is  regulated,  so  that  a 
constant  output  power  can  be  maintained.  Both  diode  temperature  and  output  power  are 
user  adjustable.  An  electrically  controlled  shutter  is  used  to  turn  the  beam  on  and  off. 
Finally,  a  lens  is  provided  to  correct  for  astigmatism  in  the  diode's  output. 

The  beam  from  the  above-mentioned  diode  system  is  expanded  and  collimated 
before  passing  through  a  polarizing  beam-splitter  cube.  This  device  splits  the  beam  into 
polarized  signal  and  reference  components. 

The  signal  component  is  reflected  from  the  LCLV  where  it  is  modulated  by  the 
input  image.  The  modulated  signal  beam  is  focused  by  the  Fourier  transform  lens  onto  the 
filter  plane  where  a  shadow  mask  and  matched  filter  assembly  are  located.  This  lens 
effectively  projects  the  Fourier  transform  of  the  input  image  onto  the  filter  plane.  A  lens 
for  regeneration  of  the  input  image  is  positioned  after  the  filter  plane,  and  a  small  CCD 
television  camera  is  provided  to  capture  it.  The  camera's  output  can  be  displayed  on  a 
monitor  and  used  by  the  operator  as  a  guide  when  adjusting  system  parameters. 

The  reference  component  emanating  from  the  beam  splitter  cube  is  directed  by 
mirrors  and  M9  onto  the  shadow  mask.  This  mask  allows  only  a  small  rectangular 
region  of  the  filter  plane  to  be  illuminated  by  the  reference  energy.  The  above-mentioned 
Fourier  transform  is  also  projected  within  this  rectangle.  The  interference  pattern  between 
transform  and  reference  signals  can  be  recorded  on  a  photographic  plate  positioned  in  the 
filter  plane.  The  exposure  which  results  is  known  as  a  Fourier  transform  hologram,  and  it 
serves  as  a  spatial  frequency  domain  implementation  of  the  classical  matched  filter  for  the 
input  image.  A  precision  mount  located  in  the  filter  plane  is  provided.  The  mount  accepts 
rigid  stainless  steel  photographic  plate  holders  which  are  held  in  place  by  small,  powerful 
magnets.  A  glass  photographic  plate  (2«2  inches)  can  be  glued  to  each  holder. 

The  photographic  plate  mount  is  located  on  a  precision  translation  stage.  The 
location  of  this  stage  within  the  two-dimensional  filter  plane  is  controllable  by  stepper 
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motors;  the  system  has  one  micrometer  positional  resolution.  Hence,  the  actual  place  of 
exposure  on  a  photographic  plate  can  be  controlled,  and  exposures  at  multiple  locations  on 
a  plate  can  be  made.  The  signal  energy  always  has  a  normal  angle  of  incidence  on  the 
photographic  plate  independent  of  the  location  on  the  plate  being  exposed. 

Mirror  Mg  can  be  rotated  about  two  axis  by  stepper  motors.  These  degrees  of 
freedom  are  used  to  adjust  the  direction  from  which  the  reference  beam  impinges  on  the 
filter  plate  mask  when  a  matched  filter  is  made.  This  direction  is  important  when 
correlating  the  filter  against  a  normal  incidence  image  transform  signal  since  the  resulting 
correlation  ray  exits  the  filter  in  this  same  direction.  That  is,  the  correlation  and  reference 
beams  appear  to  be  co-axial.  As  discussed  in  Section  III,  when  multiple  filters  are  made 
on  the  same  plate  the  associated  reference  directions  are  selected  so  that  the  correlation 
rays  appear  to  be  parallel. 

The  four  stepper  motors  which  control  filter  plate  position  and  mirror  M9 
orientation  are  driven  by  digital  programmable  controllers.  An  IBM  PC  serves  as  a 
user-interface  to  the  system,  and  it  commands  the  programmable  controllers.  The  number 
of  exposures,  the  location  of  the  exposures,  and  the  reference  energy  direction  at  an 
exposure  are  all  under  computer  control.  During  normal  operation  of  the  filter  maker  these 
parameters  are  controlled  by  a  Basic  language  program  running  on  the  PC  whirb  prompts 
the  user  for  input  in  addition  to  reading  data  from  disk.  It  is  possible  to  make  copies  of  the 
same  hologram  at  different  locations  on  the  photographic  plate,  or  if  desired,  use  a  different 
input  image  at  each  location. 

A  self  calibration  feature  is  built  into  the  above-mentioned  software.  To  use  this 
feature  an  apparatus  containing  a  quadrature  photodetector  cell  is  placed  on  the 
photographic  plate  mount.  The  photodetector's  outputs  are  converted  into  a  computer 
usable  form  by  an  analog-to-digital  converter.  The  computer  uses  this  data  to  establish 
an  absolute  positional  reference  for  alignment  purposes.  This  procedure  is  used  to 
compensate  for  filter  misalignment  due  to  filter  maker  temperature  changes  and  normal 


wear. 


The  filter  maker  is  to  be  used  to  make  matched  filters  for  use  with  the  correlator 
described  in  Section  III.  To  fully  exploit  the  correlator  the  filter  maker  must  be 
programmed  to  make  30  exposures  on  the  photographic  plate.  The  exposures  are  arranged 
in  two  5x3  arrays  as  shown  bv  Figure  3.  The  actual  locations  of  the  exposures  on  the 
plate  are  selected  to  match  the  point  foci  of  the  correlator  as  discussed  in  Section  III.  A 
design  goal  of  the  correlator  was  the  ability  to  correlate  simultaneously  an  input  image 
with  30  matched  filters  on  a  single  photographic  plate  exposed  by  the  filter  maker. 

The  filter  maker  itself  can  be  used  as  a  simple  correlator  to  compare  an  input  image 
displayed  on  the  TV  projector  with  a  matched  filter  stored  on  a  photographic  plate.  Just 
adjust  the  system  so  that  the  modulated  (with  the  input  image)  signal  beam  is  aligned  with 
the  matched  filter,  and  move  mirror  so  that  it  reflects  the  reference  beam  (passing 
through  tl.  filter  plane)  into  the  TV  camera's  field  of  view.  Block  the  reference  beam  at 
Mj  (put  a  piece  of  black  cardboard  in  front  of  this  mirror),  and  observe  the  correlation  on  a 
monitor  connected  to  the  camera.  This  procedure  should  be  used  to  test  matched  filters 
manufactured  with  the  filter  maker. 

III.  A  COMPACT  CORRELATOR 

A  small,  compact  correlator  is  described  in  this  section.  All  correlator  components, 
except  for  the  imaging  lens  and  power  supply,  are  packaged  into  a  cylinder  15cm  in 
diameter  and  30.5cm  long.  An  adjustable  focal  length  lens  (35mm  to  200mm)  for  imaging 
an  input  scene  was  used  with  the  correlator.  This  adjustment  could  be  used  by  the 
operator  to  effect  a  change  of  scale  in  the  input  image.  An  external  power  supply  capable 
of  supplying  ±12VDC  at  .2  amps  and  +5VDC  at  5  amps  is  required  for  operation  of  the 
correlator.  Design  goals  for  the  correlator  are  listed  in  Table  1. 

Figures  4  and  5  depict  the  correlator's  basic  layout.  Figure  4  is  used  below  to 
describe  the  path  through  the  correlator  taken  by  the  laser  light  before  it  is  modulated  by 
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TABLE  1.  A  Listing  of  Correlator  Design  Specifications  and  Design  Goals 


Size:  15.3  cm  diameter  x  30.5  cm  long 

Weight  (estimated):  15  lbs. 


Number  of  filter  positions: 

Input: 

Image  brightness  range  (with  attenuators): 
Input  Image  resolution: 

Response  time: 

Internal  laser  diode  light  source: 


Power  rating: 
Wavelength: 

Model : 

Number  of  diodes: 


30  mw 
780  nm 

Sharp  LT024MF 
2 


30 

direct  Imaging 
dusk  to  full  sunlight 
8  lines/mm 
1  second 


Lens  mount: 

Imaging  lens: 
Correlator  output: 
Power  requirements: 


standard  Nikon  bayonet 
35  to  200  mm  focal  length 
composite  video  signal 
+5V,  5  amp. 

+  12V,  0.2  amp. 


Power  supply 

Input:  120V,  50  Hz 

Controls:  Power  On/Off 

User  diode  #1  On/Off 
Laser  diode  12  On/Off 
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Lens  Mount 


Figure  4.  Correlator  layout  showing  elements  utilized  before  laser  light 
modulation. 
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Correlator  layout  showing  elements  utilized  after  laser  light 
modulation. 
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the  LCLV.  The  path  taken  by  the  light  after  it  is  modulated  is  described  by  use  of  Figure 
5. 

The  correlator's  coherent  light  is  supplied  by  two  laser  diodes  as  shown  on  Figure  4. 
Each  diode  has  a  nominal  output  of  30mw  and  a  nominal  wavelength  of  780nm.  The 
energy  from  each  diode  is  directed  towards  an  associated  holographic  optical  element 
(HOE)  lens  doublet  glued  on  one  end  of  the  polarizing  beam  splitter  ube  illustrated  in 
Figure  4. 

The  detailed  operation  of  the  holographic  lens  is  complicated,  and  it  cannot  be 
described  fully  here  (see  [1]).  However,  a  macroscopic,  systems— type  description  of  lens 
operation  can  be  given.  In  effect,  each  lens  utilizes  the  energy  from  its  diode  (and  only  its 
one  diode)  to  simulate  15  separate  converging  beams  with  all  focal  points  positioned  in  a  3 
x  5  array  of  points  in  a  plane  common  to  all  30  points  (15  from  each  lens)  as  illustrated  by 
Figure  3.  The  plane  containing  the  point  foci  is  labeled  "Filter  Array"  in  Figure  5. 
Furthermore,  the  15  beams  appear  to  have  parallel  axes.  The  two  laser  diodes  in  Figure  4 
illuminate  the  stacked  HOE  and  excite  30  converging  beams  (all  axes  appear  to  be  parallel) 
with  point  foci  in  the  filter  array  plane  depicted  on  Figure  5. 

The  30  point  foci  mentioned  above  have  fixed  positions  on  the  correlator's  filter 
array  plane.  These  positions  can  be  measured  and  programmed  into  the  filter  maker's 
computer.  The  goal  of  this  procedure  is  to  have  the  filter  maker  position  its  Fourier 
transform  filters  on  the  photographic  filter  plate  at  locations  which  agree  with  the 
correlator's  point  foci  when  this  plate  is  inserted  into  the  correlator  and  positioned  on  the 
filter  array  plane. 

Each  of  the  above-mentioned  converging  beams  are  reflected  from  and  modulated 
by  the  LCLV.  Figure  5  serves  to  illustrate  the  path  taken  by  one  of  the  beams;  the 
remaining  beams  behave  in  a  similar  manner.  Note  that  the  point  focus  of  the  beam  is  on 
the  filter  array  where  it  addresses  one  of  the  30  matched  filters  recorded  by  the  filter 
maker.  The  matched  filter  diffracts  the  beam  and  produces  a  correlation  beam  which  is 
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directed  towards  the  TV  camera.  This  produces  a  bright  spot  on  the  screen  of  a  monitor 
connected  to  the  camera. 

A  design  goal  of  the  correlator  was  to  have  parallel  correlation  rays  emanating  from 
the  30  filter  positions.  This  can  be  achieved  by  judiciously  choosing  the  directions  from 
which  the  reference  beams  come  when  they  illuminate  their  filter  positions  during  the 
sequenced  exposure  of  the  matched  filter  plate  in  the  filter  maker.  As  discussed  in  Section 
II,  these  reference  beam  directions  are  determined  by  the  computer-controlled  two  degrees 
of  freedom  built  into  mirror  M2  (see  Figure  2). 

Each  of  the  above-mentioned  correlation  beams  consists  of  simple  collimated  light 
having  no  focusing  power  of  its  own.  This  is  true  because  each  matched  filter  was  recorded 
with  a  collimated  reference  beam. 

A  simple  glass  lens  is  used  to  collect  and  focus  the  correlation  rays  emerging  from 
the  filter  plane.  This  lens  is  illustrated  on  Figure  5,  and  it  performs  the  inverse  Fourier 
transform  operation  depicted  by  Equation  (1-2).  A  design  goal  of  the  correlator  was  to 
have  all  correlation  rays  focus  to  the  same  location  on  the  CCD  element  of  the  TV  camera. 

The  correlator  is  capable  of  imaging  targets  illuminated  by  very  low  light  levels.  To 
achieve  this  capability  a  micro-channel  plate  image  intensifier  is  mounted  on  the 
correlator's  image  input  port  (the  intensifier  tube  is  not  shown  on  Figures  4  and  5).  The 
gain  of  the  image  intensifier  is  approximately  1.5  *  104. 

Undesirable  side  effects  which  result  from  use  of  an  image  intensifier  are  a  decrease 
in  correlator  temporal  response  and  spatial  resolution.  The  relatively  low  intensifier  output 
brightness  requires  an  LCLV  bias  setting  that  reduces  its  response  time  to  about  one 
second.  Also,  the  intensifier  lowers  the  correlator's  resolution  from  a  value  established  by 
the  LCLV  (~30  lines/millimeter)  to  approximately  8  1/mm. 
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IV.  EXPERIMENTAL  RESULTS 

A  major  goal  of  the  effort  culminating  in  this  report  was  to  get  the  filter  maker  and 
correlator  operational  to  the  point  where  matched  filters  could  be  manufactured  and 
correlations  could  be  performed.  This  goal  has  been  met;  it  is  felt  that  experimental  results 
have  been  obtained  which  are  at  the  performance  envelope  of  the  system  in  its  present 
configuration. 

Matched  filter  arrays  were  recorded  using  a  high  contrast  black  on  white  18  cycle 
(18  black  spokes)  sector  star  target  as  the  input  image.  The  same  target  was  used  for  each 
filter  in  order  to  compare  the  performance  of  each  element  in  the  array.  These  filters  were 
bleached  with  iodine  to  improve  their  efficiency. 

As  discussed  in  the  section  on  correlator  design,  a  single  element,  50mm  diameter, 
100mm  focal  length  lens  was  used  for  the  inverse  FT  lens.  Although  the  correlation  spots 
could  be  detected  using  this  lens  they  were  extremely  weak.  A  16mm  focal  length,  f/1.4 
camera  lens  was  used  on  the  correlator's  output  camera  to  decrease  the  correlation  spot  size 
and  increase  the  intensity.  This  lens  also  reduces  the  optical  noise  by  improving  light 
baffling  and  reducing  the  field  of  view  of  the  camera. 

Figure  6  depicts  typical  results  obtained  for  one  filter  bank  of  the  correlator.  Fifteen 
correlation  spots  are  clearly  visible  on  the  photograph.  Image  lighting  and  placement  were 
adjusted  to  optimize  the  results  obtained.  The  incident  light  level  on  the  target  was  15  foot 
candles  (room  light)  to  yield  a  target  luminance  of  2.7  foot  lamberts.  The  correlator  input 
lens  was  set  at  f/22.  For  most  applications  of  this  correlator  the  reference  beam  angles 
would  be  chosen  during  filter  recording  to  make  the  spots  coincide.  However,  for  evaluation 
and  demonstration  of  correlator  performance  the  reference  beam  angles  were  chosen  to 
displey  each  individual  filter. 

A  desktop  computer  with  a  TV  frame  grabber  was  used  to  digitize  the  correlator 
video  output.  Available  software  allowed  any  part  of  the  image  to  be  analyzed  and  plotted. 
Figure  7  depicts  the  fifteen  correlation  spots  seen  on  the  monitor.  This  plot  was  obtained 
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by  windowing  the  area  of  interest  in  Figure  6  and  copying  it  to  disk.  A  three  dimensional 
graphics  program  read  this  data  and  made  the  plot.  Figure  8  depicts  one  of  the  brighter 
correlation  spots. 

Correlation  on  targets  at  low  illumination  levels  was  also  demonstrated.  The  light 
incident  on  the  sector  star  target  was  reduced  to  0.5  foot  candles  and  the  target  luminance 
was  measured  to  be  7.8  x  10—2  foot  lamberts.  With  the  correlator  input  lens  set  at  f/3.8  the 
correlation  plane  appeared  similar  to  Figure  6  but  with  decreased  correlation  spot 
intensity.  A  three  dimensional  plot  of  one  of  the  brighter  correlation  spots  is  shown  in 
Figure  9. 

Correlations  were  also  obtained  using  aerial  photographs,  however  the  results  were 
inferior  to  those  achieved  with  the  sector  star  pattern.  The  primary  reason  for  this  poor 
performance  was  that  the  combined  resolution  of  the  image  intensifier— LCLV  input  system 
Vas  unable  to  resolve  the  detail  in  the  photographs. 
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Figure;  6 


Results  obtained  from  the  correlator. 

(An  input  image  consisting  of  a  simple 
radial  spoke  pattern  was  correlated  with 
15  identical  matched  filters  constructed 
from  the  input  image.) 
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Figure  7.  Three  dimensional  plot  of  the  correlator  output  shown  in  Figure  6. 
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Figure  8.  Three  dimensional  plot  of  one  correlation 
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Figure  9-  Plot  of  a  correlation  spot  with  the  target  illumination  reduced  to  0.5  foot  candle 


V.  CONCLUSIONS 

A  compact,  coherent,  real-time  optical  correlator  and  matched  filter  maker  was 
described.  The  system  was  designed  to  perform  multiple  simultaneous  correlations  of  an 
input  image  scene  captured  by  an  ordinary  35mm  lens  with  up  to  30  matched  filters  stored 
as  Fourier  transform  holograms  on  a  simple  photographic  glass  plate.  The  correlator's 
output  is  a  standard  composite  video  signal  which  can  be  displayed  on  a  simple  monitor. 
The  correlator  was  designed  to  work  over  a  wide  range  of  input  light  levels  spanning  full 
sunlight  to  dusk.  The  matched  filter  maker  was  designed  to  be  computer  controlled  and  to 
have  a  self  calibration  feature. 

Experimental  results  obtained  with  the  system  were  given.  These  included  a 
photograph  depicting  the  correlation  of  an  image  obtained  from  a  standard  radial  spoke 
pattern  with  15  identical  matched  filters  manufactured  from  this  image.  Correlations  were 
obtained  over  a  wide  range  of  incident  light  levels  spanning  full  room  light  ( 15  foot  candles 
and  above)  down  to  .5  foot  candles. 

Several  problems  encountered  with  the  system  were  described.  A  thermal  stability 
problem  is  summarized  below.  The  most  serious  problem  encountered  involved  the  process 
of  directing  onto  the  correlator's  TV  camera  the  diffracted  light  from  the  matched  filter 
plane  (the  so  called  "correlation  rays").  This  light  has  a  very  low  irradiance;  if  it  is  not 
focused  properly  it  will  not  be  detected  by  the  camera.  A  possible  solution  to  this  problem 
of  low  irradiance  is  to  build  focusing  power  into  the  correlation  rays.  This  may  be 
accomplished  by  using  a  focused  reference  in  the  manufacture  of  the  matched  filters. 
Unfortunately,  a  reference  with  different  focal  length  would  have  to  be  used  in  the 
manufacture  of  each  filter,  and  the  process  would  not  be  trivial.  An  easier  solution  might 
be  to  increase  the  irradiance  from  the  correlation  process  by  increasing  laser  diode  power 
output,  or  by  improving  matched  filter  efficiency. 

Correlator  alignment  drift  with  changes  in  temperature  is  a  problem.  Significant 
temperature  changes  in  the  operating  environment  cause  contraction/expansion  of  the 
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system  and  a  degradation  in  optical  alignment.  For  reliable,  repeatable,  long  term 
operation  the  system  should  be  operated  in  a  constant  temperature  environment. 

Several  novel  design  concepts  were  incorporated  into  the  correlator  and  filter  maker 
discussed  in  this  report.  It  is  felt  that  the  system  represents  an  advancement  in  the  state 
of  the  art  of  coherent  optical  correlator  design. 
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